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ABSTRACT 


The requirements of a Computer-Aided Learning System which would 
be a reasonable assistant to the teacher are discussed. These ideas are 
implemented ina system entitled RASCAL, a Rudimentary Adaptive System 
for Computer-Aided Learning. RASCAL replaces prepared frames used in 
previous systems with a description of questions to be asked and a tree 
of alternatives that might be helpful in assisting a student in answering 
a question. The actual ee are generated as a function of the 
system's interaction with the student, as is the selection of the branch 
to follow in aiding the student. The results obtained to date, while not 
extensive in their scope, indicate that a system such as RASCAL can be 


meerul in the classroom. 
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few TRODUC TION 


The development of the computer in the middle of the twentieth 
century is having an effect on society comparable to that of the printing 
press five hundred years ago. In the field of education, the effect has 
been to reverse the trend of standardization started by the printing press. 
In the early 1900's educators had already begun to question the worth of 
mass education as compared to the older form of individualized or tutorial 
education practiced at Oxford and Cambridge. However, no economically 
viable way of individualizing was available. The computer offers an 
economical means to individualize instruction. Considerable research 
has been conducted in the past ten years, attempting to developa 
computer-based system which would individualize the learning environ- 
ment. This research has collectively been entitled Computer-Assisted 
Instruction (CAI) or Computer-Aided Learning (CAL), with the former term 
predominating. 

While many systems have been devised, CAI, to a large degree, 
remains a laboratory phenomenon. It is felt that part of the reason behind 
this is that while systems, to date, have developed a high degree of 
interaction with the student, they have little capacity, if any, to interact 
with the teacher. RASCAL is an attempt to define a more viable system by 
identifying the proper roles of the teacher and the computer in the type of 
symbiotic relationship discussed by J. C. R. Licklider. : 


pier iden: J. C. R., "Man-Computer Symbiosis," IEE Transactions 
on Human Factors, HFE-1, p. 4-11, March 1960. 





The key to this, it is felt, is the elimination of the prepared set 
of frames that is at the core of many CAI systems. This set of frames is 
inaccessible to the teacher although teachers may have been consulted 
in the preparation. To replace this set of frames, RASCAL uses a tree 
structure which is designed to approximate the steps a teacher would 
follow in assisting a student in the solution. It is intended that the 
branches of the tree be interactively constructed, either by the teacher 
or by the computer, from a broad set of alternatives given it by the 
teacher. This interactiveness e essential in any endeavor such as 
teaching, where the methods which may succeed in one case, fail in 
another and where there is no recognized body of information on how the 
endeavor is best accomplished. The ability to modify the trees does not 
imply the necessity todo so. Thus, the teacher has the choice of using 
trees previously created and stored or of creating his own to better fit 
what he thinks should be done. 

To achieve the desired relationships, RASCAL assigns certain 
responsibilities to the computer and to the teacher. The assignment of 
responsibility is discussed in detail in Section III. Briefly, the computer 
has been assigned the responsibilities of: 1) generating problems for the 
student, 2) deciding when the student is ready to proceed to more diffi- 
cult concepts, 3) presentation of instructional frames and review material, 
4) file management and manipulation, and 5) the identification of problem 
aeecicmontne teacher. Lhe teacher has the responsibilities of: 1) identify- 


ing to the computer the student's present state of advancement and 





capability, 2) specifying the type of problems to be presented to the stu- 
dent and the conditions which make a problem difficult or easy, and 
3) the construction of branches to be followed in assisting the student to 
answer the problem. 

RASCAL is written in Programming Language/One (PL/I). Its con- 
struction is highly modular to facilitate modifying and extending the 


system. Possible modifications and extensions are dealt with in SectionV. 





II, BACKGROUND 


A. DEVELOPMENT OF COMPUTER-ASSISTED INSTRUCTION 
Computer-Assisted Instruction has evolved from the concept of 
Programmed Instruction (PI) first developed by Sidney L. Pressey at Ohio 

State University in the 1920's. Unfortunately, Pressey's ideas did not 
catch on until the 1950's or sufficient data might have been available 

to make the transition of the concepts to computer-based systems easier. 
A real interest in PI did not develop until the 1950's when Dr. B. F. Skinner 
at Harvard University presented his findings on learning. Skinner ex- 
pressed concern that the present system of education delayed the rein- 
forcement of a response by so much that the learning process was 
seriously impaired. : 

As Skinner's ideas preceded the commercial availability of compu- 
ters, they were implemented in textual form. The Programmed Instruction 
texts of the 1950's demonstrated that, properly written, tested and admin- 
istered, they are valuable instructional aids. However, the benefits are 
not without their problems. They are problems of supervision and change. 
In addition to allowing the student the freedom to study at his own rate, 
they also allow him the freedom not to study at all. Because the answers 


must be included in the text, the student is tempted merely to quickly 


Ser aoe ine lecnmology of Teaching, p. 14-22, Appleton- 
Century-Crofts, 1968. 





glance through the text simply looking at those answers he does not know 
and continuing on. Thus, the student is deprived of the opportunity to 
think his way through the questions. Furthermore, he is defeating the 
intent of any branches that may be included to provide him with a better | 
understanding of the material. Because the PI text is "hard copy," it 
cannot be easily changed. Thus, extensive testing must be performed 
before the text is released to print. This testing is most easily accom- 
plished under controlled conditions. Since the data is not collected in — 
the environment in which the text is used, there is some question as to 
its validity. Attempting to collect this data in the environment in which 
the text is used adds to the effort required by the student in using it, 
since he must keep a diary of impressions. This only encourages the 
improper use of the text. 

The development of the computer offered a means of correcting 
these defects in Programmed Instruction. The data handling of the capa- 
city of the computer allows it: 1) to continually gather data on the text 
it is presenting and to effectively evaluate the performance of the lesson, 
and 2) to keep records on the students to monitor their progress and in- 
sure that they are studying properly. The computer's erasable memory 
(or "Type Set") allows the text to be easily changed. Furthermore, it can 
be programmed so that the student does not see the answer and is forced 
to reason it out for himself. 

Thus, the earliest CAI systems were simply PI texts implemented 


on a small computer dedicated to presenting the material to students. 





These systems did not make use of the logical capabilities of the com- 
puter and were, therefore, somewhat restricted in their capacity to pro- 
vide individualized instruction. In addition, they proved to be rather 
expensive and were limited by the size of the computer. To provide a 
more individualized presentation and lower costs, these systems have 
given way to highly sophisticated systems, such as Socrates, which are 
implemented on large computers capable of serving hundreds of students 
and handling tasks other than CAI Peeeniaton.. In fact, people are | 
now beginning to talk in ae Educational Utilities. As an example 
of things to come, the U. S. Office of Education has let contracts to two 
major organizations interested in educational time-sharing. The charge 
of these coniracts isto design a CAI system having 100,000 terminals 


located in a radius of 100 miles. 


Be BRGUMENTS FOR COMPUTER-ASSISTED INSTRUCTION 

The main argument for CAI is based on the partly proven, partly 
conjectured advantages of individualized instruction and the ability of 
the Beater to provide this individualized instruction economically. 
Other arguments advanced by proponents of computers are mentioned in 
the succeeding paragraphs. 

The computer can collect and evaluate data about curriculum and 
learning. This will enable us to discover information which, SE ibe 

eatiiiG Research Laboratory University of Illinois, Report 12, 


Socrates, a Computer-Based Instructional System in Theory and Research, 
by L. M. Stolurow, June 1966. 
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CAI proves unfeasible, will allow us to improve our educational methods. 
Further, it will provide data on whether our present system is suitable 
for CAI implementation. 

Once sufficient data has been accumulated and learning strategies 
identified, the computer will be in the position to assess the student's 
abilities and present the learning strategy best suited to the student. 

In a mass~educational environment, the strategy selected must be the 
one which will help the greatest number of the students. 

The computer can ore: with the student to a surprising degree. 
While present state-of-the-art causes the machine to sometimes penalize 
students with the right idea but the wrong words and reward students 
with the wrong idea but the right words, further developments may make 
this interaction more dynamic than can be achieved in a mass education 
environment. 

Recent studies indicate that the formalism of classrooms required 
for mass education may be detrimental to the learning process. Learning 
should be an interesting experience and the formality of the classroom too 
often makes the experience distasteful for young, inquisitive and mis- 
chievous minds. The computer offers unique capabilities for reducing 
formality in education. Computers can and have been programmed to 
teach in a game-like environment. 

The computer's responses are geared to the student, and therefore, 
provide an environment in which outside distractions do not affect the 


learning process as much as in the classroom where the student may 
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miss an important point if his mind wanders. The computer cannot 
proceed until it has the student's attention. 

The computer is gifted with infinite patience and is never bothered 
by routine drudgery. Thus, it is better suited than the conventional 
teachers for administering drill and practice sessions. 

The computer can further relieve the teacher of classroom drudgery 
by administering and grading quizzes. It can keep a record of student 


progress and assist the teacher in her lesson planning. 


Cr. ARGUMENTS AGAINST COMPUTER-ASSISTED INSTRUCTION 

Arguments against CAI concern themselves with the cost of CAI, 
the effectiveness of CAI and the possible adverse effects that CAI may 
have on the student. 

While it is true that CAI is expensive, (costs vary between $400/ 
student/year and $50/student/year) this does not imply that such costs 
will continue. This same argument ran rampant in the early days of 
computers when the choice was between electronics using tubes or elec- 
tronics using transistors. Transistors did in fact cost large amounts, 
but then they were as experimental as CAI systems today. The costs of 
CAI are dropping and will most likely continue to drop as the systems 
themselves become more sophisticated. 

The argument that CAI is ineffective is a generalization a the early 
failures of CAI systems and presupposes that improvements cannot or will 
not be made. However, the potentials of CAI are so great that one should 


not be willing to scrap the entire idea because of a few earlier failures. 
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There is a fear that CAI will stifle the gifted student and lead toa 
mediocrity of all students. This argument is based on the early CAI 
systems which were merely automated PI programs. These programs, 
which were written for the average student with branching used to handle 
fast or slow students, made little use of the computer's logical capa- 
bilities. Present day systems are more imaginative in their approach 
and continued sophistication will further erode the grounds under this 
argument. 

It is also feared that CAI may produce antisocial children who will 
regard the computer as infallible. It is based on recent results which 
indicate that group interaction in school may play a very important part 
in the learning process of early school children. This argument is being 
countered by the development of CAI systems which encourage student 
meererion.- Since children do not seem to be as impressed as their 
parents with the technology of today, there is some question as to whether 
they will come to regard the computer as infallible. However, should the 
problem arise, there is the possibility that it can be corrected by pro- 
gramming the computer to make appropriate errors. 

Furthermore, it is feared that CAI will take away the teachers' jobs. 
However, CAI systems make no pretense of their need for teacher assist- 


ance. They simply cannot handle all the possible low probability occur- 


rences. Therefore, CAI should not be looked upon as a replacement for 


Gees G.L. "Student to Student Interaction in Computer Time- 
Sharing Systems," Computers and Automation, v. 18, p. 16-19, March 1969. 
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teachers, but as a supplement which, working together with the teacher, 


will provide for better teaching than is presently possible. 


ID), Slices ICATION OF CAI SYSTEMS 

Computer-Assisted Instruction systems are classified into three 
major categories according to the intent of the system. The simplest 
type of system is the Drill and Practice. This type of system merely 
supplements the teacher. Questions are asked to the student, and if 
answered incorrectly, the correct answer is supplied. However, no 
attempt is made to identify or correct the error in understanding that 
caused the incorrect response to be given. It is the most superficial 
and accordingly the most developed and economical. However, the 
value of this type of system should not be underestimated. Many types 
of problems fall into a category which requires extensive practice to 
learn the basic algorithms with speed and accuracy. In these areas, 
Drill and Practice systems have been shown to be effective. 

At the next higher level of interaction is the Tutorial system. This 
type of system is designed to take over, from the teacher, the main 
responsibility for instruction. It improves upon the Drill and Practice 
system in that remedial aid is presented when a problem is incorrectly 
answered. In addition, it attempts to provide the student with an under- 
standing of the ideas for which the problems are providing Mraetices This 
type of system exists, but in general, is not sufficiently sophisticated to 


fulfill its objective entirely. However, it can relieve the teacher of the 
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burden of teaching thirty students at once. This allows her more freedom 
to handle the individual cases where the computer fails. 

The system with the highest level of machine responsibility is the 
Dialogue type. This type of system exists only as elementary prototypes, 
but provides the deepest level of interacticn between the student and the 
computer. These types of programs represent the apex of Computer- 
Assisted Instruction systems. This type of system is not dependent upon 
the presentation of problems to determine where the student lacks under- 
standing. It is designed to ee directly with the student, allowing 
the student to identify his problems. Ideally, the student would be able 
to ask any question on a given subject matter and the computer would be 
able to provide a satisfactory answer. 

Computer-Assisted Instruction systems may also be classed accord- 
ing to their method of presenting material to the student. Figure | indi- 
cates the possible flow of a lesson in the most common methods of 
presentation. The earliest systems used a "linear" approach. The 
material was divided into a series of frames which were presented one at 
a time ina predescribed order. All frames were shown to each student. 
If the student failed to respond correctly to the material in a frame, he 
was simply given the correct response and the next frame was presented. 
A little more sophisticated are those systems which use a "simple 
branching" approach. Certain frames are designed to test the student's 
understanding of the subject being presented. If the student's answer 


indicates he has sufficiently grasped the idea, he is allowed to skip 


Ws: 








a) Linear presentation 





Advance 
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b) Simple Branching presentation 





c) Complex Branching presentation 


FIGURE 1 
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ad) Multi-level Complex Branching presentation 
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ahead to the frame beginning the presentation of the next idea instead 

of continuing to the succeeding frame in the sequence which is designed 
to provide more practice with the same idea. Or if he has missed the 
idea completely, he may be returned to a previous frame to repeat the 
material. “Complex branching" systems not only allow the student to 
skip over frames, but also provide branches which allow the smarter or 
more interested student to go deeper into a subject, and branches which 
Present remedial material to the student who is having trouble. The most 
complex type of system, — on this prepared frame idea, might be 


called "multi-level complex branching." This system is a "complex 
branching" system with a choice of paths at each node. Thus, if a stu- 
dent is having trouble and the first remedial presentation does not help, 
the machine can make a second attempt using different material. Also 
branches are provided within the branches which allow for further choice 
as to how the material is to be presented. 

A system recently proposed, which appears to offer considerable 
advantage over the prepared frame system described above, is one in 
which the frames are replaced by a format of the questions to be asked, 
and the computer generates the actual questions as a function of the 
individual student's responses to questions presented to Bae As an 
extension to this type of system, the computer could also select remedial 
aids and advanced material for presentation to the student, froma set of 


TE, L., 24th Conference Proceedings of the Association for Com- 
puting Machinery, "Teaching Machine Frograms that Generate Problems 


foe bunction of Interaction with Students," p. 125-134, 1969. 
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such items given it, based on past experience with students who have 
responded ina similar manner. As an intermediate step in the construc- 
tion of such a system, the remedial aids and advanced material might be 
given to the computer with an indication of when they are applicable. 
The computer could then construct Trees from these descriptions, 

select branches in the Trees, based on the student's response, and 
present the required material to the student. The development of this 


intermediate type of system was the goal in the construction of RASCAL. 


lhe PROBLEMS WITH COMPUTER ASSISTED-INSTRUCTION 

At the root of the arguments against CAI is the fact that CAI has 
not developed at the rate envisioned for it. This is a result of under- 
estimating the amount of time it would take to solve problems which of 
themselves are major areas of endeavor in the computer field. 

First and foremost among these is the "natural language" problem. 
While many "question-answering" systems exist for limited subsets of 
English, there still exists no way for computers to understand precisely 
what questions have been asked them on a broad basis. 

A second problem, particularly important to the elementary student, ° 
is the problem of oral language recognition. It is an accepted fact that 
smaller children have more trouble grasping concepts explained in writing 
than those explained orally. Similarly, they have more eater preseinG 
themselves in writing. Thus, a system with oral capability in both 


directions would be of immense value. 
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There exists no recognized body of fundamental theory about learning 
and retention. This makes it difficult to ee a curriculum of study or 
to determine the best choice of a branch in reply to a given response. 
Thus, curriculum planning and course programming are done on a prag- 
matic basis, using methods which have given an indication of success 
in the past, but are not assured of success in the future. This may, in 
part, account for the unimpressive results in some studies comparing CAI 
with conventional methods. 

Another problem and one where several approaches have been taken 
to solve it, is the familiar problem of communication between two very 
different disciplines. The people who are developing the systems are 
computer specialists, while the people who have the knowledge of curri- 
culum and learning are educators. The problem of the one conveying his 
ideas to the other arises. This is no small problem since they speak 
different languages. The earliest method of solution was to form teams 
of educators and programmers to work side by side. A more sophisticated 
approach has been to construct languages in which the educators may 
construct their own CAI programs without the aid of a programmer. Every- 
one has had his own ideas as to what capabilities these languages should 
embody. Asa result, there are some thirty different types on the market, 
e.g., Coursewriter by IBM and PLANIT by CDC. In the absence of a 
natural language recognizer, these languages probably are still too 
restricted for the average educator to ever desire to use. Unless a pro- 


posed change makes it readily apparent to the user, its value in making 
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his job easier, he will have nothing to do with it. The languages avail- 


able to date do not show this feature. 
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ieee OrOnS IN DESIGN 


The intent of any CAI system must be to provide an inexpensive 
and effective aid to the teacher. To accomplish this goal, it seems 
necessary to identify the functions performed by a teacher in his job and 
the knowledge he requires to perform these functions. Only then would 
one be in a position to surmise which elements of teaching the computer 
would be able to handle, and to construct a system in which the computer 


would handle these elements. 


A. mer FICATION OF CRITICAL ELEMENTS 

To describe the elements of a teacher's job as Supervisory and 
tutorial is a gross over-simplification of the problem, but it does serve 
to warn that the teacher will remain a part of the system at least in lower 
grades. Present day computers would be of little value in supervising 
thirty elementary students. Since the teacher is available, it seems 
advisable to make use of his knowledge in the system. 

The tutorial side may be broken down into the elements: 1) explain- 
ing the idea, 2) providing practice to show how the idea may be used, 
3) testing for acquisition of the idea by the student, 4) identifying prob- 
lems that may be occurring in the acquisition, and 5) reexplaining the 
idea in a different manner. The cycle then starts over at #2 ar repeats 
until successful acquisition occurs or the teacher must move on to the 


next major idea because of time restrictions on a course or the majority 


Why 





of the students are ready to move ahead. A prime justification for any 
CAI system would be its ability to eliminate the movement ahead due to 
the latter two reasons. 

The explanation of a new idea consists of introducing the vocabulary 
of the idea, explaining the relationships between the new idea and ideas 
previously taught, an indication of the context in which the idea is appli- 
cable, and examples of how the idea may be applied. The student then 
generalizes upon the idea so that he is able to distinguish in most of the 
cases when to use it. 

The purpose of practice is to reinforce the student's generalizing 
mechanisms. The teacher must have knowledge of and supply problems 
to which the idea is applicable and which beth demonstrate the variety 
of applications in which the idea may be applied. 

The purpose of testing is to insure that the student has generalized 
upon an idea properly and has adequately grasped the relationship of the 
idea to other ideas. In preparing a test, the teacher must have a know- 
ledge of questions which are discriminating, i.e., not all So easy every- 
body gets them right or so difficult that nobody gets them right, and which 
will identify the errors in generalizing and relationships the student may 
make. 

The teacher must have worked the problem beforehand and know the 
answer. He can then compare his sequence of steps with those taken by 
the student and see where they diverge. In most cases, the sequences 


will diverge at points anticipated by the teacher based on prior experience 
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in which case he will know why the student took the incorrect step and 

be able to remedy the misconception. Occasionally, though, the teacher 
must ask the student why he took the step he did. In this case, correction 
is notas simple. The teacher must do some generalizing on his own to 
determine how this particular mistake relates to other mistakes he has 
encountered. Errors do not provide the only clue to student misunder- 
standing. The amount of time it requires for the student to answer a 
question is also indicative of a weakness. 

Teachers, through experience, developa "bag of tricks" which 
enable them to correct student misunderstanding. The choice of trick to 
use depends on the prior success or failure of a particular trick in cor- 
recting similar errors in the past. When more than one "trick" will 
apparently fill the bill, the choice as to which to use rests upon the 
teacher's knowledge of the student's abilities and prior experience. 

As suggested in the previous discussion, the teacher does not step 
into his first classroom “eh a complete knowledge of what to do, although 
an outsider might obtain that impression without knowledge of the behind- 
the-scenes activities. Good teachers must prepare lessons in which the 
objective is clear and the method interesting, thorough and flexible. 

Each lesson should be evaluated by the teacher to see if his objective 
was reached, and if not, find the reason why it was not reached. 

To help the teacher in preparing, the teacher's edition of a text 
usually states the objectives of the lesson and suggests methods by 


which the objectives may be met. It provides practice problems and 


24 





explains major problems that may arise and sometimes suggests the tools 
that may be used to correct these problems in understanding. As the 
teacher's experience grows, he develops his own methods as to what to 
do when certain errors occur. He also develops a better understanding | 


of what problems are encountered. 


Bs SvolEM RESPONSIBILITIES 

It was decided that to be an effective aid to the teacher, a CAI 
system should be able to perform all of the functions discussed above. 
However, since such a system is going to be a beginning teacher, in 
comparison to the actual teacher, it was deemed allowable to give the 
teacher the responsibility of providing the same information to the system 
which he is given in the teacher's manual or has knowledge of from past 
experience. However, the amount of time and effort required of the 
teacher should not become burdensome, either in the time spent training 
the computer or learning technicalities. To keep this time at a minimum, 
it was necessary to add a third partner to the system, namely, a program- 
mer. In ae system visualized, the interactions and responsibilities dis- 
cussed below are necessary for successful operation. 

Le The Teacher's Role 

Pending a major breakthrough in the field of Artificial Intelli- 

gence, the teacher must maintain the dominant role in the system. He is 
the storehouse of knowledge and experience to which the computer must 


turn for assistance. 
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The teacher must provide the computer with his knowledge 
of the kind of problems that may be encountered in the learning of a parti- 
cular idea. He must, at the same time, provide the computer with some 
knowledge of the remedial measures to take after the problems occur. 
This information may either be given in direct cause and effect form, i.e., 
if the student makes this error then do this, or it may only be a list of 
possible methods to use when errors occur in the presentation of an idea. 
In the latter case, the computer must be able to recall which methods 
have previously worked in are situations and make a selection of 
which method it feels will work in this case. The teacher is not infallible, 
thus the computer must be able to indicate when a particular trick does 
not work and either try one of its own or request another idea. 

The teacher must indicate to the computer what questions are 
best suited for instilling the idea to be taught. This is not simply a 
matter of giving the form of the question. It must include some indica- 
tion as to the conditions which determine the difficulty of the question, 
if the computer is to make effective use of the information contained in 
the student's response. Whether the conditions are specifically stated 
to the computer or deduced by the computer from examples is a matter 
of choice and programming, but they must be obtained. 

It is the teacher's responsibility to see that the student is 
able to understand the material that is being presented. He may either 
do this by presenting the idea initially and familiarizing the student with 


the types of questions before the computer takes over. This method, 
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however, reStricts the tutorial ability of the computer in an area where it 
appears it can be of use. The other alternative is to supply information 
to the computer on how to present the idea initially. Lesson frames may 
be prepared beforehand and the computer can construct examples from the 
problem descriptions to show the student the steps which should be 
followed to obtain an answer. If the computer does the presentation, one 
must make certain that the means it has available to make the presenta- 
tion are suitable to the student's level. 

The teacher must - ready to provide assistance when the 
computer fails in getting an idea across. To build a system that would 
handle all possible situations that might arise would only increase the 
costs disproportionately to the number of students helped by adding to the 
system means to handle the situations which occur infrequently. Since 
the computer has relieved the teacher of checking up on all students, his 
time should be devoted to the cases with which the computer is having 
trouble. 

In order for the computer to interact properly with the student, 
the computer needs to know the student's level and foreseen capabilities. 
The computer will form its own conjectures as it works with the student, 
but this information is required at the start of the student's first lesson. 
It seems a simpler matter to have the teacher supply the information than 
for the computer to test each child and make an evaluation before begin- 
ning the first lesson. Further, the teacher may desire to modify the com- 


puter's conjectures and should have the ability to do so. 
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oe The Computer's Role 


The prime functions assigned the computer are generating 
problems and presenting them to the student, identifying errors and pro- 
viding proper remedial material, and deciding when a student is ready to 
advance. 

The computer must be capable of generating questions asa 
function of its interaction with the student. It must adjust the difficulty 
of the question to the readiness of the student who is to answer it. 
Furthermore, the questions drone be generated in a random fashion so 
that each student is provided with a different sequence. The type of 
problem it generates is the responsibility jointly of the teacher and the 
computer. The teacher must provide the form of the problem, but it is 
the job of the computer to decide if the problem is commensurate with the 
student's ability. Once the computer is aware of the student's level of 
achievement, it must decide if the problem it is preparing to ask isa 
hard problem or an easy problem. Most teachers begin by asking the 
student easy questions until he has gained sufficient confidence and then 
increase the level of difficulty. 

There are apparently two ways to approach the generation of 
a question of a particular degree of difficulty once the conditions govern- 
ing the difficultness are known. Either the machine can generate a prob- 
lem and then apply the conditions to determine if the problem meets them. 
If the problem does not, it can either be stored or thrown away and another 


problem generated. This process continues until a problem of the right 
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difficulty is generated. The problem here is that in a random generation, 
most questions generated will be of medium difficulty. It may require 
several attempts to produce an easy problem ora hard problem. The 
second method is to have the computer decide how difficult a problem is 
desired and then to apply the conditions during the generation of the 
problem. The problem here is that applying the conditions during the 
generation of a question is more difficult than simply testing a question 
peeeee ii it meets the conditions. It is not clear whether the extra time 
Spent is more or less than the time spent waiting for a question of the 
meeinerditticulty to occur. 

Since it is necessary for the computer to generate an answer 
to any problem it creates, it seems logical that it be able to use this 
answer to identify the error made by the student. If the program produces 
its answer in the Same manner as the student produced his, it is then in 
the unique position of being able to compare the student's steps with its 
own to determine where the student went astray. In this respect, the 
system is acting much like a theorem-prover, that is moving down a tree 
of legitimate deductions from a point where the student and the computer 
agreed to some new conclusion where they aioe Once the problem is 
identified, it is a simpler matter to select a method of providing remedial 


assistance. Either the computer can use a method it has been told to use 


ne L., 24th Conference Proceedings of the Association for Com- 


puting Machinery, “Teaching Machines that Generate Problems as a 
Function of Interaction with Students," p. 128, 1969. 
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when this occurs, or it can generalize and use a method its experience 
has shown to work before or that has worked in a similar situation. d 

The mechanism for deciding when a student should advance 
must allow sufficient questions to be asked to insure that the student has 
gained enough proficiency in the idea being presented to be able to com- 
prehend the next idea. At the same time, it must not ask too many ques- 
tions, least the student become bored. If this occurs, one of the main 
arguments for the system--namely, its ability to make learning a more 
interesting experience -- will = lost. The situation is further complicated 
by the fact that in some instances a student who was slow to catch on to 
the last idea because it was not presented properly or for some other 
reason, may catch on very rapidly to the idea now being presented. 
Therefore, if the mechanism for deciding when to proceed is dependent 
upon a student's apparent rate of comprehension, we must make sure that 
the method for determining this rate of comprehension is dynamic. In 
later grades, this problem may be reduced by allowing the student some 
responsibility as to the manner in which he progresses from idea to idea. 
In earlier grades where practice is essential, it has been suggested that 
this matter may be of lesser importance because generally students enjoy 
doing what they can do and would not become bored. However, it is felt 
that this mechanism must have some dynamic quality, else why bother to 
individualize instruction. The smarter student may be content to show 
his prowess and the slower student just as happy to move on to some- 
thing else. 


Tid : 
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ce The Programmer's Role 


Educationally speaking, the role of the programmer is minor. 
Functionally speaking, it is of major importance. His is the responsi- 
bility of seeing to it that the files established contain all the information 
required for making meaningful reports to the teacher and all the informa- 
tion utilized by the computer in its decision making. He is also respon- 
sible for creating the computer's library of "tricks" based on the teacher's 
recommendations of the remedial methods required in a particular course. 

4. Interface between nlepehien and Programmer 

The teacher has the job of initiating communications across 
this interface by making his needs known to the programmer. In the type 
of system visualized, the programmer would not be a part of arranging the 
learning sequences. This, hopefully, will ease the communication prob- 
lem discussed earlier. 

oe Interface between Teacher and Computer 

In the relationship between the teacher and computer, it is 
the computer which must take the responsibility for successful communi- 
Cation if it is expected that the system will not add to the burden of the 
teacher. 

Essentially, this means the computer must be able to communi- 
cate with the teacher in the teacher's own language. Although some effort 
is required in well-structured subjects such as mathematics and the 
sciences, this is a solvable problem since these subjects have a language 


all their own. Simmons discussed several natural language systems. 
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CARPS by Charniak and STUDENT by Borrow have application in the sub- 
ject we are ee ncenG. ° Uhr suggests that the same may also be true 
in the teaching of foreign languages, although the problem is not as 
clear anon In subjects such as arts and history, where the language 
used is much greater in size and scope, the picture is even leSs clear. 
Failure to provide a natural means for the teacher to con- 
verse with the computer requires that the computer prompt the teacher 
memeene intormation it desires. As the teacher gains experience with the 
information that the computer eee and the format in which it is to be 
delivered, the prompting mechanisms will probably become an odious 
delay in getting the information to the computer. There will probably also 
be times when the teacher does not have the time to give the information 


to the computer directly and would rather leave the information for the 





computer to digest while the teacher is engaged elsewhere. 

Thus, it is necessary that this channel of communication be 
able to act in at least three modes: 1) an interactive-prompted mode, 
2) an interactive-unprompted mode, 3) an off-line mode. In each of 
these modes extensive error-checking routines must be available to the 
computer to insure that it has received all the information it requires 


and in the right format. 


Ss oieeri R. F., "Natural Language Question Answering Systems: 
mol, Communications of the ACM, v. 13, p. 21, January 1970. 


9 
Uhr, L., 24th Conference Proceedings of the Association for Com- 
puting Machinery, "Teaching Macnines that Generate Problems as a 


Punection of Interaction With Students," p. 126, 1969. 
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Furthermore, the teacher may not desire to impart a totally 
new set of information to the computer, but only to modify information 
previously given. Thus, the system also requires an extensive editing 
package which must meet the same requirements as the original I-O 


package. 
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IV. IMPLEMENTATION 


In order to test the applicability and the veracity of the ideas dis- 
cussed in Section III, construction was begun on a system which would | 
be capable of teaching fourth grade mathematics. The system was given 
the name RASCAL (Rudimentary Adaptive System for Computer-Aided 
Learning). Rudimentary because it was to be a first try and hence, cer- 
tain simplifications were made to the original ideas. Adaptive because 
it Was hoped that the system would be able to generate questions and 
present remedial material based on its interaction with the student. The 
selection of fourth grade arithmetic as the subject to be taught was based 
on several factors: 1) fourth grade arithmetic is a highly structured sub- 
ject with the relationships between the ideas taught well established, 

2) the remedial measures used are fairly straightforward in most cases 
and available in the teachers’ edition of the text book used by the 
Monterey Unified School District, 3) the descriptions of problems to be 


asked are fairly simple and relatively limited in format. 


A. STRUCTURE OF RASCAL 

Internally, RASCAL is structured into Levels which correspond 
roughly to a daily classroom lesson. This generally consists of intro- 
ducing a new idea and practicing it, or extending the previous idea to 
larger numbers. Each Level is then broken down into Problem Types 


which represent the type of questions to be asked in cementing the ideas 
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corresponding to the Level. Each Problem Type consists of a description 
of the form of the question and a list of the conditions that describe the 
difficulty of the question. Questions are classified as Hard, Medium or 
Easy. Associated with each Problem Type is a Tree which describes the 
next action to be taken by the computer. These Trees constitute part of 
the tutorial mechanism of the system. Each node of the Tree contains the 
number of times a node is entered, the conditions for entering a node, and 
memerocess tO be Carried out if the conditions are met. The nodes are ~ 
grouped together in sets es on their applicability to the node preceding 
them in the Tree. Figure 2 is a simplified diagram of this structure. For 
a complete example, refer to Appendix A. 

The Problem Type for the question is selected on a random basis. 
Once the Problem Type has been selected, the computer examines the 
conditions applicable to the difficulty it desires to make the question and 
generates a question accordingly. Each Level has associated with it a 
Levelt Frame which constitutes the rest of the tutorial process. It consists 
of a written explanation of the idea being presented as it might appear 
in the text book and example problems. Thus, it resembles the manner in 
Which a teacher may introduce a new idea. In RASCAL, the teacher is 
assigned the function of breaking the course into Levels and describing 
the Problem Types associated with each Level. He is also responsible 
for creating the Tree of remedial steps associated with each ProblemType. 
The main elements of the computer's job consist of generating problems, 


presenting the problem, calculating an answer, selecting a branch of the 
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Tree, performing the operation in the branch, and determining when to 
advance the student. Refer to the flow chart in Appendix A. 
i. Description of a Problem Type 

The description of a Problem Type consists of the format ion 
the problem and the conditions describing each level of difficulty for the 
problem. The format of the problem is limited to the standard Infix form 
and the answer to be supplied by the student must be to the right of the 
equal sign. Although it is realized that fourth grade problems do not 
always call for the answer to be to the right of the equal sign, i.e., 
7 + answer = 13, it was decided to limit the form initially and then to 
later expand the system to be able to handle formats where the answer to 
be provided could occur anywhere in the description. Arguments to fill 
the operand locations consist of the twenty-six alphabetic letters and 
operators are the four elementary mathematical operators, ‘+' for addition, 
‘-' for subtraction, '*' for multiplication, and '/' for division. The occur- 
rence of the same letter in operand positions will cause the same number 
to replace the operand in each of those positions. Refer to Example l. 

Example 1 
If the problem format is 
sl GP 0) = (6 =a 
then three numbers will be generated and the 
problem presented to the student might be 


Teo 6) a Cer 
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However, if the format of the problem 
were given as 
a+ (b-b) = ; 
then only two numbers would be generated 
and the problem presented to the student 
might be 
7+ (3-3) = ?. 

The conditions for describing the difficulty of a problem must 
be entered in the order: Hard, Medium, Easy. In each case, the language 
used to describe the conditions is the same. The first conditions given 
are the sizes of the number to replace each distinct argument in the prob- 
lem format, and these must be specified. In addition, optional conditions 
may be specified as is discussed in the next paragraph. The size of the 


number is specified in the form 


(argument) '=' (number) 
e.g., a = 2, which says every time the argument a is encountered, in 
the problem format, it is to be replaced by the same two-digit number. 
Optional statements to specify conditions of difficulty allow 
for conditions to be specified: 1) on a particular digit of an argument, 
2) between any two digits of different arguments having the same place 
value, 3) on the sum of the digits in any place value position, .and 4) 
between any two arguments. Example 2 shows the form required for each 
©: these Conditions. 
To identify the place value, the first two letters of the place 


value names are used if it is a single word, and the first letter from each 


38 








name if a two-word name, e.g., UN for units and TT for ten thousand. 
This method is used in preference to the actual names for simplification. 
To identify a particular digit, the place value name followed by the argu- 
ment, enclosed in parentheses, in which the digit is located is required, 
e.g., UN(a) identifies the units digit in argument a. 

The operators that may be used in specifying conditions con- 
sist of relational operators, '<' for less than, '>' for greater than, '=' 
for equal, '<=' for less than or equal, ‘'>=' for greater than or equal, 
'**' for multiple of, and '//' for divisible by. The use of letter descrip- 
tions, i.e., ‘'L.T.° for less than or the actual words themselves were 
also considered as possibilities. They were not included since it only 
adds a non-essential and easily solvable complication to the system. 
The letter descriptive or word forms must be reduced prior to use. To 
attempt to use the symbols in letter form when the conditions are being 
applied, only slows down the generation of the numbers to fill the argu- 
ment positions. The relational symbol for Not (~) was also eliminated. 

Each condition must be separated from its predecessor by a 
comma, and the last condition must be followed by a semi-colon. A 
formal definition of the language for specifying Problem Types is located 


in Appendix A. Appendix B contains a complete problem description. 


Sy 
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Example 2 


PONDITIONS FOR SPECIFYING THE DIFFICULTY OF A PROBLEM 


On a particular digit of an argument. 


1 
Form: ( i we (argument) °)" ) (number) 


value operator 


Examples: Nias / trib) > 3 

Between two digits of different arguments. 

a place ueroument).°)" relational\ /place a arene 
ae \ value 2 operator /\value cae ey 
Examples: Mis se UN ta) TE(a) > TEN (b) 

On the sum of the digits in a place value poSition. 

a ( place fo) faanben 

— value operator 

Examples: UN >= 10, UN <=9 


Between two arguments. 


Form: (argument) oo) (argument) 
> operator 


Examples: a// b, a’ b, a ** b 
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a. Description of Trees 


To properly allow for the description of the Trees for providing 
assistance, it was necessary to determine what types of remedial pro- 
cesses might be used inthe Tree. The first thing that might be tried if 
the student has trouble would be to give an example and then ask an 
easier question. If this does not work, then one might try to use a spccial 
trick called a Function in the terminology of the system. If still unsuc- 
@eeotul, then a statement to the student of what he has done wrong might 
be in order. If the misunderstanding is basic, then a re-presentation of 
the lesson frame may be required. Also, it may be desirable to ask the 
student why he responded in the manner he did to help decide which of 
the remedial steps above is the most appropriate. 

It was decided that the language used to specify the Tree 
should allow for all these possibilities. The general form 

We pole StAClion) *: 
was decided upon. Type consists of a two-letter description of the cate- 
gory discussed above to which the action belongs. These letters are the 
first two letters of the descriptive word identifying the category discussed 
above to which the Action belongs; thus, PR fora problem, QU for ques- 
momo) tor statement, FR tor frame, FU for a function call, and HA to 
halt the procedure and present the correct answer to the student if his 
answer is wrong. The Action part of the form depends upon the Type. 


Example 3 shows various possibilities. 
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- 
- 
- 
; 


If the type of process is PR, then there are six possible 
Actions that may be specified. HARD, MEDIUM and EASY designate that 
a new problem of the difficulty indicated should be generated using the 
same problem format. Refer to Example 3a. NEW designates that a prob- 
lem of a different form is to be presented. It should be followed by the 
format of the new problem to be presented. If the arguments used in this 
description are the same as those used in the format of the original prob- 
lem, the numbers of the original problem will be used to replace the argu- 
mients of the new problem. Refer to Example 3b. If different arguments 
are used, then the computer will generate new numbers, so the number 
of digits these numbers are to have must also be specified. Refer to 
Example 3c. REPEAT designates that the original problem is to be asked 
again. EXAMPLE indicates to the computer that it is to show the student 
an example problem of the same format and level of difficulty as the one 
he has answered incorrectly. 

If the Type is QU, then the Action to be performed is the 
question to be asked, followed by the replies that are to be considered 
correct, enclosed in parentheses and separated by commas. These replies 
are limited to one word to simplify matching them with the student's 
answer. Later, they were to be of any size. Refer to Example 3d. 

If the Type specified is ST, then the Action should be justthe 
sentence or sentences to be presented. 

When the Type is FU, then the Action part of the form is to be 


the name of the Function or the file number of the Function to be used. 
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a) 


Example 3 


SEO tention s OF REMEDIAL METHODS 
The original problem presented to the student is: 
8+6= ? 


generated from the problem format ‘'a+b=;' using the 
conditions specified for a problem of Medium difficulty 
fay, b—1, UN{a) .6, UN(b) > =4;'. 


The remedial process is: 'PR:EASY' and the conditions for an 
Easy problem are 'a=1,b=1, UN (b)<=3;'. 


The computer will present a problem similar to: 
opt b= 


The remedial process is: eR NW DOta=;". 


The computer will present the problem: 
6+8= ? 


The remedial process is: PRN e=-d—,Cc=—l,d—1,c 7d; 
The computer will present a problem similar to: 
6-3=? 
The remedial process is: 'QOU:Do you understand the difference be- 
tween addition and subtraction? (yes);'. 

The computer will display to the student: 

Do you understand the difference 

between addition and subtraction? 


If the student answers ‘yes', the computer will consider this a 
correct answer in searching for the next branch in the Tree it 
is to take. 


The remedial process is: ‘'FU:NUMBER LINE' and NUMBER LINE is 
a Function which presents a number line 
to the student. 


The computer will display to the student: 


< 


Bee, 6) U67lCOC8lCUGlCUL0 
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The teacher, of course, will have a listing of the Functions available. 
However, if he has lost his copy or cannot find it, he should be allowed 
to call the Function by name, Therefore, the name of a Function should 
agree as closely as possible with the terminology of the teacher. It is | 
still possible, though, that a match cannot be made between what the 
teacher calls a Function and its name in the system's library of Functions. 
Thus, the error-checking routines in the system should include a mechan- 
ism for determining which Function names match the closest to the name 
given by the teacher and ieee a replacement, either by asking the 
teacher which one he means when in the interactive mode, or selecting 
the closest match and informing the teacher of the substitution when in 
the off-line mode. Refer to Example 3e. 

When the Type is FR, the Action part of the format is the name 
of the level or level-number to which the frame is associated. The same 
comments apply to the error-checking routines as apply when the Type 
Samais FU, 

Before presenting a remedial node toa student, the computer 
must decide whether or not the node is applicable. Thus, each node in 
the Tree contains a list of conditions which describe the situation in which 
the node applies. The construction of these conditions is presently the 
responsibility of the teacher. Thus, the language for communication be- 
tween the teacher and the computer provides for the list of conditions to 


be specified in the manner discussed below. 
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The conditions themselves may be based on 1) whether the 
answer is right or wrong, 2) the difficulty of the problem, 3) the student's 
ability, and 4) particular differences in the answer calculated by the 
computer and the student's answer. To describe a condition of the first 
type, the terms RIGHT and WRONG may be used. The terms HARD, 
MEDIUM and EASY may be used to describe the difficulty of the problem. 
FAST, AVERAGE and SLOW are to be used in describing the student's 
ability. When referring to the student's answer, the term SANS is to be 
used, and the term MANS is os be used in referring to the machine's 
answer. 

It is possible to specify a particular digit of the student's 
answer or the computer's answer when stating a condition by the use of 
a period as a delimiter and a number which corresponds to the place value 
of that digit. This number is the location of the digit when examining the 
answer from right to left. Thus, 1 corresponds to the units digit, 2 cor- 
responds to the tens digit, and soon. It is not necessary to qualify 
both the terms SANS and the term MANS if the digits to be compared have 
the same place value. If they have a different place value, then the 
place value must be specified in both terms. It is also possible to specify 
conditions on the student's answer and the answer of the computer by 
specifying a relation between an arithmetic combination of the student's 
answer and the computer's answer and a number. Qualification of the 
student's answer and/or the machine's answer is possible in this case 


also. 
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The set of relational operators that can be used in relating 
the elements of a condition list are the same as those which are used in 
describing a Problem Type with the addition of '&' for and, ' |' for or 


and ' for not. The hierarchy of these operators and a formal Sener 
tion of the language for describing Trees is located in Appendix A, 
Example 4 gives examples of condition lists. 

While the term ‘remedial’ has been used to describe the 
branches in the Trees, this is not the only type of function the Trees 
serve. Nodes may also be specified for the more successful student. 

oF Advancement of the Student 

The mechanism for advancement of the student is dynamic in 
the sense that the number of problems asked in any given level is depend- 
ent upon the answers the student gives to the problems asked. Students’ 
responses are Classified into three types: 1) those answered correctly 
on the first try, identified as Right; 2) those answered correctly after the 
presentation of remedial material, identified as Prompted; and 3) those 
which could not be answered correctly even after the presentation of 
remedial material, identified as Wrong. 

The first step undertaken by the computer in the presentation 
of material to the student is to select the Problem Type to be presented 
from those in the Level the student is being taught. This is done ona 
random basis. Once this is done, the computer knows the form of the 
problem. It must then decide how difficult the problem is to be. Initially, 


all Problem Types are given an Easy level of difficulty. For each Problem 
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Example 4 


@enDITION LISTS FOR DESCRIBING THE APPLICABILITY OF A NODE 


Assuming a hypothetical student, who is considered to be fast 


learner and who has answered 'll' to the problem '13+8=?', which is 


Considered to be a Hard problem, conditions of the following types might 


be specified: 


a) 


The condition string: RIGHT & FAST 


is false. 


The condition string: WRONG 


is true. 


ihe Cencdition string: WRONG & SLOW 


is true. 


The condition string: © WRONG & ( FAST |MANS.2 >SANS. 2) 
is true. 
The condition string: | WRONG & ( FAST |MANS.2 >SANS) 


OF 
WRONG & ( FAST |MANS > SANS. 2) 


would be interpreted in the same manner. 


If specified as: WRONG & FAST |MANS.2 > SANS.2 
it would not be interpreted in the same 
manner due to the hierarchy of operators. 


However, the condition string is still true. 


The condition string: © WRONG & (AVE |FAST) & (MANS-SANS=10) 
is false. 

If specified as: WRONG & AVE |FAST & MANS-SANS=10 
it is true due to the effect of the hierarchy 


of operators. 
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Type a Score is kept which indicates how well the student is doing on that 
Problem Type when the problems being asked are of a particular level of 
difficulty. Should the Score exceed or equal .7, the level of difficulty 
for that Problem Type is increased to the next level of difficulty, and the 
Score for that Problem Type is reset to zero. When the level of difficulty 
for a Problern Type is at the Easy level, each Right response by the stu- 
dent adds .2 to the Score for that Problem Type. Each Wrong response 
reduces the Score by .2. Those responses by the student which fall into 
the Prompted category have no effect on the Score of a Problem Type. 
When the level of difficulty for a Problem Type is set to Medium or Hard, 
the Score of the Problem Type is only increased or decreased by .1. When 
a Problem Type is set at the Hard level of difficulty and its Score equals 
./, the Problem Type is marked as completed. Since Problem Types are 
selected randomly and since students may have more success on one 
Problem Type than another, it is possible that one Problem Type may be 
marked as completed, while the other Problem Types in that Level still 
require more practice by the student. Problem Types which have been 
marked as completed are presented only every third time selected for pre- 
sentation. This provides review for the student and allows the computer 
to concentrate more on other Problem Types where the student has been 
less successful. 

When all Problem Types have been marked completed, the 
computer checks to see if the student is ready to advance to the next 


Level. Each time a student's response to a question was classified as 
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being Wrong, that question was added to a Hard List. To test if the stu- 
dent is ready to advance to the next Level, the computer asks the questions 
stored on this Hard List. The computer keeps track of the number of prob- 
lems asked and the number answered correctly. No remedial presentation 
or assistance is given. If the student correctly answers 70% of the prob- 
lems on the Hard List, he is advanced to the next Level. If he cannot 
correctly answer 70%, then he is sent back to try again. Whena student 
is returned to the same Level to try again, the level of difficulty to which 
all Problem Types are set is send ent upon the number of times he has 
failed to correctly answer 70% of the questions on the Hard List. If itis 
the first time he has failed, the level of difficulty on all Problem Types 
is set at Hard; on the second failure, they are set to Medium. Ifa third 
failure occurs, the teacher is called to identify the problem and provide 
assistance. After the teacher signifies that the student is ready to con- 
tinue, all Problem Types are given an Easy level of difficulty and the stu- 
dent is allowed one more attempt. If he fails again, he is demoted to the 
next lower Level and the teacher notified. 

All questions appearing on the Hard List, for the first two 
Levels below the Level at which the student is working, are stored in the 
student's file. They are intended as a source of review questions. How 
often a review problem should be asked is a pragmatic question, and it 
has not been decided how often this should occur in RASCAL. Some con- 
sideration has been given to the idea that it should be a parameter of the 


system which can be set by the teacher. 
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The system also allows for downward movement and demotion 
in a similar manner. If the Score for a particular Problem Type becomes 
less than minus .5, the level of difficulty for that Problem Type is reduced 
to the next lower Level. If the level of difficulty is already at Easy, and 
the Score falls below minus .5, then the Problem Type is marked. After 
that, a problem is presented to the student only every third time the 
Problem Type is selected. If the Score for a Problem Type so marked ever 
returns to a value greater than minus .5, the marking is removed and the 
Problem Type is treated just like any other Problem Type with a level of 
difficulty equal to Easy. This is to allow for cases where the understand- 
ing of one Problem Type may depend upon the understanding of another 
Problem Type. Thus, the Problem Type with which the student is having 
trouble is held in abeyance, until a sufficient number of problems from 
the Problem Type which is a prerequisite have been asked to, hopefully, 
allow the student to understand the Problem Type with which he is having 
trouble. This should not be the case too often, since Problem Types 
which tend to be prerequisites should be at a lowe Level, but allowance 
must be made for the possibility. If the Score of a Problem Type ever falls 
below minus one, then the student is demoted one Level and the teacher 
notified. Each time a Problem Type is marked for falling below minus .5, 
a check is made to see how many others are so marked. If the percentage 
of Problem Types marked in this manner exceeds 25% of the number of 
Problem Types in the Level, a Slow student is demoted. For the Medium 


Student the percentage is 50 and for the Fast student, 75% is the limit. 
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It was mentioned earlier that a third type of response, Prompted, 
was allowed. It is used only in the determination of the student's abilities 
for the next Level. The manner in which this is accomplished is that each 
problem asked, regardless of its category, is added to a count of the num- 
ber of problems asked at that Level. Upon completion of a Level, the 
number of questions asked the student is compared with the average num- 
ber of questions asked in the Level. The ratio of the number asked to the 
average number is the deciding factor. If this ratio is .5 or less, then 
the student's abilities are marked as Fast; if the ratio exceeds 2, then 
the student's abilities are marked as Slow. In between, they are marked 
as Average. Whena student is demoted, a flag is set so when he ad- 
vances again to the next Level, his abilities are marked as being one 
Level lower than that calculated by the above mechanism. 

4. Problem Generation 

Because of the manner in which the mechanism for advancing 
the student works, it is necessary for RASCAL to apply the conditions for 
describing the difficulty of a problem at the time the problem is generated. 
By making certain simplifying assumptions, it appears that this method 
will allow problems to be generated faster than the other method described 
earlier. Two methods for applying the conditions to the generation of the 
problem were considered. 

The first method considered is "set reduction." The computer 
would produce a large set of problems and then apply the conditions to 


eliminate elements of the set. Then it would choose a problem at random 
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from those remaining after all conditions had been satisfied. This method 
appears to be limited by the size of the initial set the computer must 
generate and save. The second method might be called "trial and modify." 
The computer would generate a question and then begin to apply conditions 
to it, modifying the question so that it fit the condition. The problem with 
this method is that if a condition forces a change in the problem, it must 
then go back to check that a previously checked condition has not been 
violated. Ifthe conditions are too stringent, this could become a dog- 
chasing~its-tail situation. The method used in RASCAL is a modification 
of this second method with several simplifying assumptions made. 

While it is assumed that contradictory conditions are not in- 
tended, no effort is made to understand which conditions are actually 
meant. Minimal changes are made and if this does not remove the contra- 
diction, it is simply ignored. Further, it is assumed that the conditions 
Specified by the teacher will be realistic in the sense that they will not 
reduce the set of problems that may be asked to a very small number, and 
thus, become overly critical. If this assumption is made, then it is 
possible to eliminate the necessity for rechecking every condition when- 
ever a condition forces a change. Instead, it is only required that one 
make minimal changes and be satisfied with slight deviations from the 
actual conditions. Allowance for the fact that the problems generated may 
vary slightly from the actual specifications, is the reason the student 
must answer 70% of the questions on the Hard List before being allowed 


to proceed to the next Level. This provides a check to see if he really 
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understands, in the event that by answering problems not up to par, the 
student is thought ready to advance. Example 5a gives examples of con- 
ditions that might be considered contradictory and the Action that may be 
used to resolve the conflict. Example 5b shows how a problem may be 
modified so as not to fit the conditions perfectly. 

Since the generation of numbers to replace the arguments in 
a problem definition is done a digit at a time, it is necessary to break 
the optional conditions into three groups. Group 1 consists of those 
Conditions which relate a particular digit to a number, e.g., UN (a) —or 
Group 2 consists of the conditions which relate two digits, e.g., 

UN (a) >UN(b) or which relate the sum of the digits in a particular place 
value to a number, e.g., UN 7=10. In group 3 are those conditions which 
relate two arguments, e.g., a b. To speed up the scan of the conditions 
and to insure that the interpreter will find all conditions, it is necessary 
that all conditions in Group | precede those in Group 2. Those conditions 
in Group 2 must precede those in Group 3. Refer to Example 5c. 

The computer begins by picking the first argument from a list 
that has been created. This list contains all the arguments that occur in 
the problem format. It then determines the size of that argument and allo- 
cates storage to hold the number which will replace the argument. This 
is done for each argument on the list of arguments. When all storage has 
been allocated, the computer returns to the head of the list. Beginning 
with the Units position, the computer scans the list of conditions for all 


conditions belonging to Group’ 1 which affect the Units position of the 
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first argument on the argument list. If none are found, the Units position 
for that argument is filled with a random number in the range 0-9. If 
conditions are found, they are used to modify the range of the random 
number and then the Units position is filled. At the same time, a choice 
parameter is set which tells how the digit just generated may be modified 
when attempting to meet a condition belonging to Group 2. 

Once all the Units positions for arguments on the argument 
list have been filled, the computer then checks for conditions on the 
Units position belonging to Group 2. They cannot be checked prior to 
this since a digit affected by a condition belonging to Group 2 may not 
yet have been generated. In attempting to satisfy a condition for Group 
2, the computer makes only those adjustments which are allowed by the 
choice parameter for the digit in question. If after making all allowed 
modifications, the condition from Group 2 is not satisfied, it is ignored. 
When all conditions from Group 2 affecting the Units position have been 
satisfied, the computer starts at the head of the argument list and begins 
filling in the Tens digits of those arguments declared to have two or more 
digits. Those arguments having a lesser number of digits than the place 
value being filled are skipped over. The process continues until all the 
digits of the largest argument are filled. 

When all the digits of all the arguments have been filled, the 
computer scans the list for any conditions from Group 3. In satisfying 
these conditions, the computer disregards all previous conditions but 


only minimal changes are made to satisfy the conditions in Group 3. 
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Example Sc gives a detailed description of how the numbers for a 
problem are generated. 

The choice of how a digit may be modified by a condition from 
Group 2 is dependent upon the conditions from Group 1 encountered when 
generating that digit. If no conditions belonging to Group 1 are encoun- 
tered, then the digit may be modified in any manner. If the conditions 
encountered include the use of the relational operator '//', '**', or '=', 
which are given top priority, no change is allowed. If the conditions use 
'?' or '>=', then the digit may be increased any amount providing it does 
not exceed 9. If the conditions use '<' or '<=', then the digit may be 
reduced by any amount provided it does not go below zero. If both ‘7 ' 
or '>=' and ‘<' or 's=' are used in the conditions encountered, the digit 
may be increased or decreased by a minimal amount. 

Whenever a condition has been interpreted by the computer, 
it is removed from the condition list. This increases the speed of inter- 
pretation but does not allow for conditions to be rechecked after a modifi- 
cation of the numbers due to another condition. This is as intended; 
however, it does require that the order in which the conditions belonging 
to Group 2 or Group 3 are listed be given some thought. The computer 
handles these conditions as encountered so conditions that operate on the 


Same argument must be listed in the manner which will produce the effect 


closest to that actually desired. Refer to Example 5d. 
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Example 5 


CENvltnoliiNG PROBLEMS OF A SPECIFIED DIFFICULTY 


a. Specifications Are Contradictory 





Problem: 6 ap |8) = 3 

Conditions: a=1, b=1, UN(a)?6, UN(b)> 4, UN<10; 

If the original numbers generated to fill the Units of ‘a' and ‘b' 
are 7 and 5, then following the minimal change policy, ‘a' would be re- 
duced by one to the value of 6. Since the condition UN <10 is san not 
satisfied, 'b' would be reduced by one to the value of 4. The condition 
UN <109 still not being met, 'a' would be reduced by one again. This 
yields the values 5 and 4 for the Units of ‘a' and ‘b' respectively. 

In this case, the minimum change policy is not the best to follow, 
but it does resolve the conflict. Things turn out this way because UN “10 


has priority since it belongs to Group 2. 


lye Problem Is Slightly Altered from the Specifications 

Problem: a/b =; 

Seicmions a=!) b=!) UNia)*8, UN(b),7 =3, a//b; 

Pv tnese conditions, a might be 6 and 'b' could be 9. Since 
a//b has priority by virtue of belonging to Group 3 and because it contains 
the "divisible by" operator, the policy of minimum change would produce 


a=9, b=9 which is a slight bending of the conditions. 
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om A Complete Example 


Problem: atbt+c=; 


Conditions: a=2, b=2, c=l, UN(a)>4, UN(b)<5, UN(a)>UN(c), 
wie lO; TE = -9- 


Argument List: 2) le Re: 

ee The first step by the computer is to allocate storage for ‘a', 
'b' and 'c'. When this is done the condition list has been reduced to: 

Onteee 4 UN) <5, UN(a)>UN(c), UN> 10, TE<=9: 

a The condition list is then searched for conditions on the Units 
position of 'a' and a match is made on UN(a)?>4. Thus, a random number 
is generated in the range 4-9. Suppose 5 is the number selected. It is 
indicated that this number can be increased. This leaves the condition 
BST: 

UN (b) <2, UN(a) 7UN(c), UN?10, TE<=9; 

oF The condition list is searched for conditions on the Units 
position of 'b' and a match is made on UN(b) <5. Thus, a random number 
is generated in the range 0-4. Suppose 2 is selected. It is indicated 
that this number can be reduced. This leaves the condition list as: 

UN(a)” UN(c), UN>10, TE <=9; 

4. The condition list is searched for conditions on the Units 
position of 'c'. No match is found so a random number is generated in 
the range 0-9. Suppose 6 is selected. This indicates that this numbcr 
may be changed in any manner. The condition list is left as: 


UN(a) 7UN(c), UN >10, TE <=9; 


on 





on Since the Units digit for all arguments has been generated, 
the condition list is searched for any other conditions on the Units posi- 
jon. The first selected is UN{a) 7UN(c). Since 'a' is less than 'c', the 
computer must make an adjustment. The manner in which 'a' may be modi- 
fied is checked and it is seen it can be increased any amount as long as 
it remains less than 9. The minimum change to satisfy the condition is 
2 and the maximum allowed is 4. Thus, a random number is selected in 
the range 2-4. Suppose3 is selected. This number is added to the Units 
amet Of a, Making this digit 8. The condition list is now: 

UN>?10, TE<=9; 

6. The condition list is searched for any more conditions on the 
Units position and UN >10 is found. Since the sum of the digits inthe 
Units position is already greater than 10, no action is required. If the 
sum was less than 10, each argument's Units digit would be examined 
to see if it could be increased. If a digit could be increased, a random 
number would be generated and the digit increased by that amount. If the 
Units were still less than 10, another digit would be looked for to in- 
crease. If no others could be found, the same digit would be increased 
Peiineuntil it could not be increased further. If the UN <10 condition 
were still not satisfied, it would be ignored. The condition list would 
now be: 

Ie) ieses ele 
is Again the condition list is searched for conditions on the 


Units position. Since none would be found, the computer would begin to 
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search for conditions on the Tens digit for argument 'a'. None would be 
found, so a random number in the range 0-9 would be selected. Suppose 
7 is selected; the indication is made to show that this number can be ad- 
justed in any manner. The condition list remains: 

TE *%=9; 

8. A. search is now made for conditions on the Tens digit of the 
argument. Since none are found, a random number in the range 0-9 is 
selected. Suppose 9 is selected; the indication is made that this number 
may be adjusted in any manner. The condition list remains: 

TE s=9; 

oO. Since the size of argument ‘'c' is only 1, no search is made 
for Penditions affecting the Tens digit of argument 'c'. Instead, the 
search is made for any conditions affecting the Tens position and TE<=9 
fomreund . 

0; Up to this point, the numbers generated are: 

a=78, b=92,c=6. 

Thus, the sum of the Tens digits including the carry is 17, which is 
greater than 9. The Tens digit for argument 'a' may be adjusted down- 
ward. However, a net change of 8 is required and the Tens digit of ‘a’ 
may only be reduced by 6. Thus, a random number in the range 1-6 is 
selected. Suppose 4 is selected, and the Tens position of 'a' is reduced 
by 4. Thus a = 38, and the sum of the Tens digits is now 13. Since the 
sum is still too large, the Tens digit of argument ‘b' is examined to see 


if it may be reduced. Since it can, and since it may be reduced by 8 


ore. 





while the reduction required is only 4, a random number in the range 4-8 
is selected. Suppose 7 is selected. This number is then used to reduce 
mie tens digit of argument 'b'. Thus, b= 22. 

Hele Since all conditions have now been satisfied, the search 
ceases and the problem presented to the student is: 

Som ee eo = 7 

ae Had the condition list been incorrectly prepared so that all 
the conditions of Group 1 did not precede those of Group 2, i.e., a=l, 
Beoeic=), UN(a) >UN(c), UN(a)?4, UN(b) <5, UN> 10, TE<=9;, the fol- 
lowing would have occurred: 

The search for conditions on the Units of 'a‘ would have yielded 
UN (a) >UN(c), which does not qualify as a condition belonging to Group 
1, and would have been ignored. This is because the search is geared 
to find the first occurrence of 'UN{a) 7". 

When the time came to search for conditions belonging to Group 2, 
the condition string would be: 

UN(a) “UN(c), UN(a) 74, UN710, TE=9; 

The condition, UN({a) 74, would be found but, not belonging in Group 2, 
it would be ignored. Thus, the fact that the Units of 'a' should be greater 
than 4 would never be established. 
cm Importance of the Order of Conditions in Group 2 and Group 3 

Problem: (atb) + (a-b) =; 


Conditions: ‘a' is 1 digit, 'b’' is 1 digit, and UN(a) >UN(b), UN <10 
are desired. 
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The condition string could be written as: 
1) a=1, b=1, UN(a) 7UN(b), UN <10; 
or 
2) a=l1, b=1, UN <10, UN(a)> UN (b); 
Form 1 should be used if it is more important that the condition, 
UN <10, be true than for the condition, UN(a) >UN(b), to be true, since 
this insures that the Units will be less than 10. There is no guarantee 
mieetie Units of a’ will be greater than the Units of ‘b'. Consider the 
case where a=8, b=4, after oe the condition UN(a)>UN(b). To 
satisfy the condition, UN “10, ‘a' will be reduced by a number in the 
range 3-7; thus, it is possible that the result may turn out to be a=2, 
b=4. 
Form 2 should be used if it is more important that the condition, 
UN (a) 7UN(b), be true than for the condition, UN <10, to be true, since 
this guarantees that the Units position in the answer will be less than 10. 
If both are equally important, then the condition should be written 
as: 
UN (a) <=5, UN(a) >UN (b). 
This insures that both conditions will be met, but reduces the set of prob- 


lems that can be generated. 
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on Generating an Answer 


Once the numbers have been generated to replace the arguments in 
a problem, the computer must calculate the answer to the problem. Since 
the computer is well known for its calculating abilities, it would bea 
simple matter for it to go through the problem format, performing the indi- 
cated operations. However, this would not provide information as to the 
steps involved for future comparison with the steps taken by the student. 
Therefore, a more sophisticated process is employed. 

The original problem in Infix notation is converted to Polish nota- 
tion. After each operation is performed, the result is stored in a chain 
of partial answers, thus providing a sequence of answers which can be 
compared with the student's answer. 

In addition, each operation is performed in the manner it would be 
expected that the student would perform the operation. Addition and sub- 
traction are done digit by digit with borrows and carries remembered. 
Multiplication is done so that each sub-multiple is retained and these 
are added to produce the final answer. Division is performed by comparing 
the divisor with the digits of the dividend from left to right until a division 
resulting in a number greater than zero can be performed. The division is 
then performed on that partial dividend, and the remainder determined. 

The process is repeated on the remainder and the remaining part of the 


dividend. 
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BD: . Interpreting Trees 

The interpretation of trees consists of two parts: interpreting the 
conditions for a branch, and interpreting the process to be performed in 
that branch. Interpreting conditions is done by converting the list of 
conditions into Polish notation and then operating on the Polish form by 
using a pushdown stack. Thus, the interpreter is not as fast as it could 
be. It must consider the whole condition string before arriving at a truth 
Pamue tor the string. For example, the condition string ‘RIGHT & FAST’. 
is converted into the Polish eee ‘RIGHT, FAST, &'. This forces the 
examination of the truth value of the term FAST even if the student's 
answer is wrong. A faster method would be to group & and | operations 
and test them one ata time, stopping as oan as one element of the And 
condition is false or aS Soon aS one element of an Or condition is true. 

The placement of the nodes during the interpretation is critical. 
After completing the process at a node, the computer examines the condi- 
tions on the set of nodes at the next lower level in the Tree, associated 
with the node just completed. These nodes are linked together in a Se- 
quence. The examination starts at the first node in the sequence and stops 
as Soon aS a condition string is found whose value is true. Consider 
Examples 4b, 4c, 4d. All of these have a value which is true. Thus, if 
they are in the sequence 4b, 4c, 4d, the condition strings 4c, 4d will 
mever be checked. Since 4c is less stringent than 4d, it should not pre- 
cede 4d. Else 4d may not be examined as often as it should. The correct 


ordering is 4d, 4c, 4b. 
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Once the condition interpreter has found the proper node, then the 
process associated with the node must be carried out. This interpretation 
is geared to the keys discussed on page 41. Once the key has been 
identified, it is only necessary to further qualify the action in some cases 


and then perform the action associated with the key. 


By, DEVELOPMENT 

It was decided to use Programming Language/One (PL/I) to imple- 
ment the workings described in Section A. The choice was governed by 
the prime necessity of using a language with string manipulation capabili- 
ties and which could be used in an On-line situation. This narrowed the 
choice to SNOBOL IV and PI/I. While the string manipulation facilities 
of SNOBOL outweigh those of PI/I, PL/I was chosen because of other 
limiting factors on the use of SNOBOL. 

Having reached the programming stage, it became apparent that an 
organized sequence of developmental steps was necessary due to the 
size of the program planned. The first stage was to be the development 
ora Drill ae Practice system built around Levels and Problem Types, 
and incorporating the advancement mechanism described earlier. Input 
of the required information to construct the Levels and Problem Types was 
to be non-interactive at this stage, the information being obtained from 
preconstructed files. The Levels were to comprise only aacuone sub- 
traction, multiplication, and division problems dealing with integer 


mumoers.. 
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At stage two, the addition of the Trees describing remedial material 
was to be accomplished. This included the construction of an interpreter 
for conditions and processes, and the construction of the routines for 
carrying out the processes. It also requires the construction of the rou- 
tines which perform the more common tricks associated with problems that 
the system was limited to at this stage. 

Stage three was to be the construction of student files and to test 
out the system on actual fourth grade students. Stage four was to be the 
creation of the teacher's ieee side of the system. This included 
construction of the prompted I-O package, error-checking routines and 
editing routines, and the output to the teacher of results with students. 

At stage five, the system was to be expanded to handle problems 
defined in other formats than the one discussed on page 37, and expan- 
sion of the Levels to include fractions and decimal numbers. 

At stage six, the main idea was to make those modifications which 
it was felt would make the system run more smoothly based on the results 
obtained to this point. 

Stage seven was to begin making extensions to the system as dis- 


eiscea in pection V, 
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V. CONCLUDING REMARKS 


To date, stage one has been completed and some programming has 
been done on stage two. The results of this work, while incomplete, do 
indicate that the system is feasible, and with some modifications and 
extensions, can be a viable means for providing individualized instruction. 

Operating as a drill and practice type system with all routines in 
core, RASCAL used approximately 100K of storage. Thus, it is estimated 
that with the routines for handling Trees included, RASCAL could be run 
ona system with 250K of core. Since some overlaying is possible, this 
figure is probably overly pessimistic. Any overlaying done must be care- 
fully planned so as not to affect the interactiveness of the system. This, 
especially, is a factor since the attention span of most elementary school 
children is shorter than that of adults. While, at present, RASCAL 
appears to be interactive enough, the effect of the modifications to be 
discussed is unknown. Since the size of the computer systems now being 
discussed for CAI is quite large, it does not seem unreasonable that 
they should have some multi-processing capability. This would insure 
that systems such as RASCAL would be interactive enough, since while 
one problem was being asked, the next problem to be asked could be 
generated. The size of these computer systems also makes ae core 
requirements of RASCAL satisfactory. 

For reasonable conditions on the difficulty of a problem, RASCAL 


can, by eliminating the rechecking of a condition, generate problems 
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fast enough to prevent the student from having to wait between problems. 
However, two failings in the present method of generating problems have 
been noted. The first is that the failure to recheck a condition, when 
generating the problem, makes it necessary for the teacher to spend more 
time in constructing the conditions to insure they are in the proper se- 
quence. The second is that another group of conditions appears to be 
needed for complicated problems. For example, the problem '(atb)/c= :' 
might require the condition, '(atb)//c', to be specified. The first prob- 
lem may be solved either by Secretar the method to include a recheck of 
conditions or by making the computer do the necessary ordering. The 
second problem requires only an expansion of the interpreter which inter- 
prets conditions regarding problem difficulty. 

One further comment regarding the problem generator, deals with 
the method of identifying a particular digit of an argument. It was 
decided to use 'UN(a)' to describe the Units position of argument ‘a' 
instead of ‘a.1l' because of the intent to expand the system so that Units 
(a) would be allowable. This was thought to be clearer to the teacher. 
Such thinking was not carried over to the interpreter for determining when 


a node was applicable where the '.1' notation is used to qualify a refer- 

ence to the machine's answer or the student's answer. This inconsistency 

may be a source of confusion necessitating the change of one method. 
From the teacher's standpoint, the method for describing a Problem 


Type appears reasonable. The examples in Appendix B were written with 


little difficulty by a fourth grade teacher after a brief explanation of the 
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constraints in the language. An ideal extension would be for the computer 
to be able to interpret the word description of the conditions which pre- 
cede the actual specifications in Appendix B. 

The specification of the Trees to be used by RASCAL is consider- | 
ably harder, and as presently written, would probably not be acceptable 
to the teacher. There are two major reasons for this unacceptability. The 
necessity of properly ordering the nodes, as discussed earlier, greatly 
increases the amount of effort that must be expended. This could be eels 
rected, either by providing a re for the computer to order the condi- 
tions, or by modifying the present means of determining the applicable 
nodes. This new method would allow the computer to test all nodes for 
applicability. 

The second reason is more basic to the concepts of the system. The 
teacher uses his "bag of tricks" almost without thinking. Through experi- 
ence, the correct method occurs to him almost as a reflex action. Thus, 
it is difficult for him to sit down and put on paper what may occur when 
a particular problem is presented to the student. Even when he does make 
this effort, he finds himself blocked by the limitations in the language 
which only adds to his frustration. Thus, it may have been premature to 
eliminate the programmer from the construction of the Trees. It may be 
necessary to have the programmer convert the English descriptions of a 
node, similar to those in Appendix B, into tasks that the computer can 
perform. This should still be an easier job than trying to create a set of 


frames to present to the student. 


68 





Two elements in the present system also need to be corrected to 
make the Trees more flexible. At present, the Trees are true trees with 
no loops allowed. However, certain types of errors require the same 
procedures to be followed; thus, it is wasteful of core, to say nothing of 
the burden to the teacher, by forcing repetition, not to allow looping. 
However, if looping is to be allowed, two problems must be taken care of. 

First of all, the computer must have some means of insuring that 
students do not get caught ina loop. Secondly, there must be a means 
for the teacher to specify which node starts the procedure he wants to 
use at a particular point in the Tree. For the teacher to say 'Go to Node 
5,' requires that he have an understanding of the system and how it num- 
bers the nodes. Since this is one of the things one does not wish to 
require of the teacher, it lends support to the idea of having the program- 
mer construct the Trees. A possible method of doing this, without using 
the programmer, would be to use a terminal with graphic capabilities. 
Then the computer could display the eee to the teacher, and he would 
only have to point to the node he wanted. The computer would handle 
the linking. Such a terminal would also be useful in the Edit routines 
required by the system for the same reason. 

The second correction required is that the computer needs to check 
to see if the student has performed the correct operation. If the problem 
were 'a*b= _ ;', the student, not really understanding multiplication, 


might add. The simple way of providing this capability would be to add 


conditions of the form, 'SANS=atb', to the types of conditions allowed 


69 








for specifying the applicability of a node. A better way might be to have 
the computer automatically do this check; and, if the situation arises, 
branch to a routine for handling the occurrence. This would be a start on 
extending RASCAL so that it creates its own Trees from a set of general 
methods specified by the teacher. This would be a difficult task to ac- 
complish, but it would alleviate the problems encountered in having the 
teacher create the Trees. 

The idea that RASCAL should be able to follow the steps the student 
takes in reaching his answer i been partially implemented in that the 
system performs arithmetic operations the way the student would and 
stores the partial results. The mechanisms for actually comparing these 
to the student's steps remains to be implemented and should be given a 
high priority in completing the implementation of the system. 

A final extension to any system such as RASCAL would be for the 
system not only to generate its own Trees, but also for it to generate its 
own remedial methods. This is an extremely difficult problem and is sim- 
ilar in concept to the idea in Samuel's Checker-Playing program, where 
the computer would generate its own parameters by which to evaluate its 
moves. Concrete ideas on how to do this do not exist, and it is likely 
that it will be some time before there is a CAI system which can generate 


its own methods for providing assistance to the student. 
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APPENDIX A 
RASCAL - THE COMPUTER'S SIDE 


FORMAT DESCRIPTION OF LANGUAGE 
FOR COMMUNICATING WITH RASCAL 


The meta-symbols used in the description of the language serve 
the following functions: 


> are used to enclose items which are not elements of the 
language and can be broken down further. 


[ ] aresUcedstOnenclose Optional items. 


are used to indicate a choice of one of the items 
oe Gmelrosed 1S to be used. 


| is used to indicate the 'Or'’ operation. 


are used to contain word descriptions of items which 
cannot be defined in another manner. In the event there 
is a possibility of confusion between a metasymbol and 
a symbol in the language, the actual symbol is also 
enclosed in quotes. 


10 lene cctomncicate a limitation on the size of the 
i items enclosed. 


= is used to indicate a definition. 
<language>::=<problem description><tree description> 


eet . ) #:=<problem format><hard conditions><medium 
ete LON GondtrtLoms casy CONnditI1ons” 
format Oger 4 tor 
arith 
Cpeuacer 


CIDJE[FIGJH[TJI[KIL|M[N[o|P]Q|RIS| TI ULV [WI 
Z 


<operand>: :=<argument> |<argument? ( ) Opera nade 


Se ouUmMents::= A| B 
XY 








Tweheneop = + |=) *|/ | 
Mitnemecond1ivon>::=-<condition list type I>; 
enedammecendition>::=<condition list type 1>; 
aeaeyecondieton>::=<condition list type 1>,; 


ae te detest 2es--optional conditions- 
eos ele 
<digit sizes>::=<argument>=<number>|<digit sizes>,<argument>= 
<number > 
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<number> 


eae ait>::=0|/1)213!4(5/617/8|9 
Benditio 


::=<digit>|<number><digit> 


Ms ticns) Pet cnoupmie | [<proup 2>||(<group 3>] 


<group 1>::=<place value><rel. operator><number>|<group>1 


Si ecuvalwe><rel. 


b 


Opelravor -—number> 


<rel. operator>::= <|<=|]>]>=|=|//{|** 


Peace value> ::= 


SserOoup 2> 


UN |TE|HU|TH|]TT|HT|MI|TM|HM|BI 


::=<element a>|<element b>|<group 2>,<clement a> 


|<group 2> , <element b> 


SelementL a> ::=<place value> 
Spboce value= 


<element b> 


(<argument>) 


ese ocesvaluc><rel . 


Seommoperator> 


(<argument> ) 


wet wom nu Mninen 


Paoup) o>; :-<argument><rel. operator><argument>|<group Se S 


“Mie Mie mel. OperYator><arpument> 


weree Gdescription>: 


esti: “ete 


type 2 Seon st POM 


—conu1t1on 
<comad 1 On 
<(e tool al ie ene 
SCordied On 
acon! t lon 
second it Lon 


emelational>::=§|'|' 
ile 


seondition :=<key word> 


I 


key sword>:; 


Poco ronelist type 2> 5 


processor iq 


[—] <condition 1>|[-y<condition 2>|[7] 


oe 
Sts type 
ie 
Pest ete 
o> | 
List Gype 
Se 


Jere at Tonal = 
Peaorelational> 


Pororekat Prone. 


RIGHT | WRONG | FAST | AVERAGE | SLOW | HARD | MEDIUM|EASY 


Sieg <machines answer> 
peondition 2Z | i falc tel. VOpetator= 
<students answer>. 
<students answer> 
<machines answer> 
m@GQnaition 4>° 25 <machines answer> ae ean ee eiucents 
<students answer> <machines 
answer> 
; [—]  <rel. operator><number> 
answer> 


ee 





MANS |MANS. <number>?° 
1 


SANS | SANS. <number> +0. 


I 


Smoachnines answer>: : 


Mermaents answer>:: 


eprocess>::-<proc I><proc 2><proc 3><proc 4><proc 5><proc 6> 
aenoc 1>::= PR:<action 1> 
feetion 1>::= NEW , <problem format>,<digit sizes>|HARD | 


MEDIUM | EASY | REPEAT | EXAMPLE 


momoe 2>::= QU:<question> (<answer list>) 
Beamiestion>::-"An English language question. ' 

<answer list>::=<answer>|<answer list> , <answer> 
misewer>:;= ‘One word correct answer to the qucstion.' 
SpugeGro-.:—- ol: <sStatement> 

Saereement.,:= English sentence or sentences. ' 

<proc 4>::= FU: <function name>| FU:<function number> 
Suet 1on Mame>::= "English name of a system function.' 
Smet lon number>::=<number> 

<proc 5>::= FR:<frame name>| FR: <frame number> 

<frame name>::= ‘English name of a system frame. ' 
<frame number>::=<number> 


Semoc 6>:;°5= HA: 
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GENERALIZED FLOW CHART FOR RASCAL 


( maceiat 

















I/O and Editing 
routines for teacher 


\ communications 


Teacher 


Obtain needed 
information 
from student 
file.. 








* , No Student's 
= Answer 
Establish | Come 
Levels Provide 









Problem Types 
and Trees 


Assistance 
ftom bree [Or 
Problem Type 


| Yes 
Provide any 
advanced work in 
Tree for Problem 
Type 















piclect 
Problem 


Type 





aad ee 





djust 
Parameters in 
Advancement 
Mechanism 





PRO-GEN 
generates 
a question 















Demote No 
student 







SHOW 
presents 


problem to 
student 





Yes Yes 






Adjust Level Revise 
Number and Student 
Notify Teacher 






PROBSOL 


Calculates 
Ponect 


Answer 


Record 
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HIERARCHY OF OPERATORS FOR CONVERTING 


INFIX PROBLEM PORMAT TO POLISH 





HIERARCHY OF OPERATORS USED IN CONVERTING 
COMP Wei ests FOR SELECTING 
BRANCHES INTO POLISH 





fis 





IMPORTANT ELEMENTS IN THE INTERNAL STRUCTURE OF RASCAL 


ive ls 10) 


NAME NR_P_A LEV PTR FRM_PTR 















EE _Infix Expression of Problem 
PROBLEM J. 3) 
PRODLEM, $f Polish Expression c of Problem _| 
CONDITION—~— ditions for Hard Problem _| 
——————> Conditions for Hard Problem __ 


a Conditions for Med. Problem | 


Se COINETEUKE NS eee ately S 1s for Easy Easy Problem ea dl 


A A TS 











~ 


O 


=| Argument list. 





P BRANCH 
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pbuccess 


NODE “| Success 
success _ 
COND_P ok 12 allman 


puUcCcess> 

















Success 
Cop. 2 


+ ei Nae Or 


PROC_P 


NODE 


pSucess 







CONDITIONS 


ON THE NODE 
See tOABME Ty 


'D 


PROCESS TO 
EOLEOW IF 
CONDITIONS 
MET 


Ua 





APPENDIX B 
RASCAL - THE TEACHER'S SIDE 


sample Descriptions of Levels and Problem Formats 


Level 1 ~- ADDITION AND SUBTRACTION 

The purpose of this level is to provide practice for the understanding 
of: 1) the relationship between addition and subtraction, 2) the basic 
facts in addition and subtraction, and 3) the communative and associative 


properties of addition. 


Problem Type 1: 
Sian) Os ee 


This Problem Type is intended to provide practice in the basic 
assition and subtraction facts, stressing the communative property 
of addition and the relationship of addition and subtraction. 

Problems are HARD if one number is greater than 10. 

Problems are considered MEDIUM if both the numbers are greater 
than 4. Problems are considered EASY if one number is less than 4. 


These conditions are specified to the computer as: 


HARD: aa2 see UN 10 
Lippitt a—-l, b=-l, UNia) 74, UN(b) 74 
Eon: a= eas UW) (be 


Problem Type 2: 


atbt+c= ; 


This Problem Type is intended to provide practice in add- 


ing more than two numbers ina problem. The communative and 
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associative properties of addition are stressed. Some prac- 
Pcewn Carrying in addition is given. 

Problems are considered HARD if one number is greater than 
ten and carrying is required in the Units place. MEDIUM prob- 
lems consist of three numbers less than 9. Problems are con- 
sidered EASY if two of the numbers from 0-9 are under 5. These 


conditions are specified to the computer as: 


HARD: eee eect, UN - 10 
MEDIUM: a=l1, b=1, c=l 
EASY: a=1, b=, c=1, UN(a)<5, UN(b)<5 


Level 2 - ADDITION AND SUBTRACTION 

The purpose of the level is to provide practice for the understanding 
of: 1) the relationship between addition and subtraction, 2) the commuta- 
tive and associative properties of addition, 3) carrying in addition, 4) 
borrowing in subtraction, and 5) working with larger numbers which 


requires greater accuracy. 


Problem Type 1: 


3) ae lei =) 

This type of problem is intended to provide practice in 
adding two and three-digit numbers and carrying. 

HARD problems are numbers in the hundreds where carrying 
is required in the Units and Tens place. In MEDIUM problems, 
there is carrying in the Units place only. MEDIUM and EASY 
problems consist of numbers between 10 and 99. EASY problems 
require no carrying. These conditions are specified to the 


computer as: 
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HARD: ener o=37 UN-10, TE 710 
MEDIUM: a=2, b=Z, UN>10, TE <10 
EASY: aaeyeo=c, UN -10, TE<10 


Problem Type 2: 


C=) = > 

This Problem Type is intended to provide practice in borrow- 
ing in subtraction and working with larger numbers. 

HARD problems, consisting of numbers between 100 and 
9999, require borrowing in the Units and Tens place. MEDIUM 
problems, numbers 10 and 99, also require borrowing. EASY 
problems require no borrowing and are numbers between 10 and 99. 


These conditions are specified to the computer as: 


HARIO: ecetgee=ce te oo) UN (b) > UNic), TE(b) 7TE(a) 
i rmuiveewe—2, b—2, c>b, UN(b)>UN tc) 
EASY: eee e- oe) UN (5) “UN(C) 


Problem Type 3: 
at pet c= | 


This Problem Type is intended to provide practice in adding 
three larger numbers, carrying, and understanding the communa- 
tive and associative properties of addition. 

All problems require carrying in the Units, Tens and Hun- 
dreds places. They differ in that HARD problems consist of 
numbers from 100-999; MEDIUM, from 10-99; and EASY, com 
1-99, where one number is less than 10. These conditions are 


specified to the computer as: 
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HARD: Gasemo-o7ee—o, Hi -l0, TE +0, UN? 10 
Vim uivieee a—2, o=2, c=2, TE 710, UN 710 
ley j—2yeeaoec—t, te -L0j;- UN 710 
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B. DESCRIPTIONS OF CONDITIONS AND PROCESSES FOR SAMPLE TREE 


The functions referred to in the nodes perform the following tasks: 


Ie Inverse ~- Changes a problem to the inverse of the 
problem, e.g., atb=c c-a=b. 


va Number Line - Presents the student with a number line 
Sie Objects - Presents the student with a picture of the 
Rok a * * 
problem, e.g., 4+2= ; 4 1. a 


NODE 1 
The student has answered the question correctly, and the teacher 
desires to stress the communative property, so ask ‘bta' ;'. 
COND: Ree TL; 
Pe Olee PReNEN, Dta= ; 
MODE 2 
The student has answered the question incorrectly, and the teacher 
desires to give him another chance before proceeding further. 
COND: WRONG; 
PROG: Pein PE AA, 
NODE 3 
The student has answered the question 'bt+a' correctly, and if it 
is a MEDIUM or EASY question, the teacher desires to drill him further on 
the family of facts by asking ‘Answer-a= '. 


COND: Pe aco alk, 


FROG: EU INVERSE. 
NODE 4 


The student has answered the question bta incorrectly and the 


teacher desires to follow the same steps as for atb. 
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COND: WRONG 
PROC; GO: N@DE 2: 


INODE 5 
The student has answered the question 'Answer-a=' and for further 


drill, the teacher desires to ask ‘Answer-b= '. 


COND: Rieu. 
PR@c: PU SUN WS oe ae 


NODE 6 


The student has answered the question 'Answer-b= ' incorrectly and 


appears to have added instead of subtracted. 


COND: WRONG & SANS =a + b= ; 
PROC: ST: You added when you should have subtracted.; 


NODE 7 


The student has answered the question 'Answer-a= ' incorrectly, 


so the teacher desires to give an example of the idea that subtraction is 
inverse of addition. 
COND: WRONG; 
EROG. Sie to LO -3—/; 
NODE 8 
The student has answered the question ‘Answer-b=' correctly and 
the teacher desires to generate a new problem. 


GOND: RIGHT; 
PROC: HAS 


IN@DE 9 


The student has answered the question 'Answer-b= ' incorrectly, and 


the teacher desires to follow the same process cited when "“Answer-a= 


is answered incorrectly. 
84 





COND: WRONG; 
PROG: €O@-- NODE 3: 


NODE 10 
After presentation of the statement in Node 6, the teacher desires 
to give the student another chance at the problem. 


Cony: WRONG; 
PROC: PRC (PB Jel Bye al be 


NODE 11 
After presentation of the.statement in the same node, the teacher’ 
wishes to follow the same process followed at Node 10. 


COND: WRONG; 
PROG: GO NODE 10: 


IM@WE 12 
The student gets the question right after the appropriate hint, and 


is to get a chance at the problem 'Answer-b= '. 


COND: RIGHT: 
PROC: CO? NODES: 


iNODE 13 
The student still cannot get the correct answer after the hint, and 
the teacher desires to give another problem. 


COND: WRONG; 
Proc: ighe\. Gh 


NODE 14 
The student answers the question correctly on the second try and 


is allowed to proceed. 
COND: Rieti: 
PROG: Cie NODE 
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NODE 15 


The student gets the second try wrong and appears to be subtracting 
instead of adding. 


GOND: WRONG & SANS=a-b; 
PROG. ST: You subtracted when you should have added. 
NODE 16 


The student gets the second try wrorg and it appears he is not 
carrying. The teacher desires to show him an example. 


COND: WRONG & HARD & MANS-SANS >=10: 
PROC: PRee EXAMPLE: 


MODE 17 
The student gets the second try wrong and it appears he was just 
careless and the teacher warns him. 


COND: WRONG & HARD & MANS-SANS $10; 


PROG; ST: You added too hastily. Try it again and be 
more careful. 


NODE 18 

The student has gotten the second try wrong and none of the pre- 
vious cases fit, so the teacher desires to use the number line to give 
hima clue. 


COND: WRONG; 
PROG: EOer NUMBER LINE: 


NODE Vo 


Following the clue that the student is subtracting instead of adding, 


the teacher desires to repeat the question. 


COND: WRONG; 
PROC: CO. ODE Z, 
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NODE 20 
After an example, the student gets the problem right, and the 


teacher desires that he continue. 


COND: RIGHT; 
PROC: Cee NODE 1; 


MODE 21 
Even with an example, the student still gets the question wrong, 


and so the teacher wants the lesson frame represented. 


COND: WRONG; 
PROG: Ger NODE Z: 


IMOIDE 22 
After warning the student to be more careful, the teacher desires 


that the question be repeated. 


COND: WRONG; 
Eee: Gor NODE. 2: 


MebDE 23 


With the help of the number line, the student gets the question 


right and the teacher allows him to continue. 


Gon: RIGHT; 
PROG: GOs NODE 1: 


NODE 24 


The number line fails to help the student so the teacher wants to 
give him some objects which he can count. 


COND: WRONG; 
ROC: PACE SG) 1 Olle 
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MODE 25 


After a representation of the lesson frame, the student gets the 


problem right and the teacher allows him to continue. 


COND: RIGHT: 
EROE.: Ge: NODE i: 


NODE 26 


Even after the representation of the lesson framc the student cannot 


get the problem right, so the teacher decides to try another problem. 


COND: WRONG; 
Pe @G: ie 


NODE 27 
After being given objects to count, the student gets the correct 
answer, he is allowed to continue. 


COND: RIGHT; 
PROG: Ge. NODE 1; 


NODE 28 
Even objects to count do not help the student, so the teacher 
decides to represent a previous lesson frame on the relations of numbers. 


CON; WRONG; 
ELLOG: EROS oO; 


MoDE 29 
After the representation of the lesson frame, the student gets the 
correct answer, but is not allowed to continue and a new problem will be 


presented. 


COND: RIGHT 
PROG: [EVANS 
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NODE 30 


Nothing helps the student, so the teacher decides to try another 


problem. 


COND: WRONG; 
Poe. BAe 


The conditions ‘SANS=a-b and ‘SANS=atb', and the process 'GO: NODE 
(number)' used in this example are not presently allowed in the language 
for specifying Trees. They were not included originally because other 
means of accomplishing the same ideas were available. They were in- 
tended to be included later in the development of RASCAL. In preparing 
the example, however, it was thought better to use these items for the 


sake of clarity. Further discussion of these items is located in Section V. 
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